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ARI  Research  Reports  and  Technical  Papers  are  intended  for  sponsors  of 
R&D  tasks  and  other  research  and  military  agencies.  Any  findings  ready  for 
implementation  at  the  time  of  publication  are  presented  in  the  latter  part  of 
the  Brief.  Upon  completion  of  a  major  phase  of  the  task,  formal  recommen¬ 
dations  for  official  action  normally  are  conveyed  to  appropriate  military 
agencies  by  briefing  or  Disposition  Form. 


FOREWORD 


The  research  presented  in  this  paper  was  conducted  under  the  Train¬ 
ing  and  Education  project  in  the  Engagement  Simulation  Technical  Area 
of  the  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences 
(ARI) .  The  goal  of  this  project  is  to  provide  quantitative  methods  for 
evaluating  unit  proficiency.  The  means  for  achieving  this  goal  include 
basic  research  in  criterion-referenced  test  methodology,  measurement 
and  scaling  models,  and  decisionmaking  implications  of  test  score 
interpretation . 

Related,  ongoing  programs  within  the  Technical  Area  include  evalua¬ 
tion  of  small  combat  units  under  simulated  battlefield  conditions  (REAL- 
TRAIN,  ARTEP) ,  qualification  of  tank  crews  and  platoon  gunnery  (IDOC) , 
and  improvements  in  the  reliability  of  ARTEP  evaluation. 

Anticipated  future  research  under  the  Training  and  Education  project 
includes  the  development  of  a  computer  model  for  performance  evaluation 
and  development  of  measurement,  scaling,  scoring,  decisionmaking ,  and 
quality-control  models  for  use  in  performance  evaluations  when  criterion- 
referenced  testing  procedures  are  employed. 

ARI  research  in  this  area  is  conducted  as  an  in-house  effort,  re¬ 
sponsive  to  the  requirements  of  Army  Project  2Q762722A764.  Without  the 
invaluable  logistics  support  of  the  4th  Battalion  of  the  40th  Armor 
from  Fort  Carson,  however,  the  project  would  not  have  been  possible. 
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A  PARTIAL  VALIDATION  OF  FORECAST  ENGAGEMENT  SIMULATION 
EXERCISE  OUTCOMES 


BRIEF 


Requirement : 

To  evaluate  the  validity  of  board  war  game  forecast  data  for  use 
in  determining  benchmarks  or  standards  against  which  unit  performance 
in  engagement  simulation  exercises  can  be  compared. 


Procedure : 

Military  experts  attempted  to  distinguish  between  engagement  simu¬ 
lation  exercise  data  from  the  Combined  Arms  Test  at  Fort  Carson,  Colo. , 
March  1978,  and  board  war  game  exercise  data  generated  by  the  Fort  Car- 
son  Forecasting  Game.  An  inability  to  differentiate  between  field  and 
forecast  data  suggests  that  the  two  data  sources  can  be  considered  to 
be  identical  and,  consequently,  that  generated  data  can  be  used  to  de¬ 
velop  behavioral  benchmarks. 


Findings : 

Judgments  were  made  on  maps  of  maneuver  routes  and  tables  summariz¬ 
ing  casualties  suffered  and  weapvi  system  inflicting  casualty  data.  The 
military  experts  were  not  able  to  correctly  classify  maneuver  route  in¬ 
formation  as  1  'field)  or  simulated  (game  board)  data.  Furthermore, 
they  tended  t  issil  •  simulated  casualty  data  as  real. 


Utilization  of  Findings: 

Results  from  this  study  indicate  that  board  war  gaming  provides 
realistic  process  and  product  data  that  military  experts  cannot  dis¬ 
tinguish  from  field  exercise  data.  With  continued  research  on  its  vali¬ 
dation,  the  forecasting  procedure  can  be  used  to  develop  performance 
benchmarks  with  which  unit  performance  can  be  compared. 
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A  PARTIAL  VALIDATION  OF  FORECAST  ENGAGEMENT 
SIMULATION  EXERCISE  OUTCOMES 


INTRODUCTION 

The  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences 
(ARI)  is  conducting  research  on  improved  training  and  evaluation  systems 
for  small  combat  units.  One  system  currently  under  development  is  tacti¬ 
cal  engagement  simulation  (ES) ,  a  two-sided  tactical  field/maneuver  ex¬ 
ercise.  To  evaluate  unit  performance  in  ES  exercises,  performance  bench¬ 
marks  or  standards  must  be  defined.  The  dynamics  of  two-sided  field 
exercises  do  not  permit  exact,  deterministic  standards,  however.  The 
standards  must  be  in  the  form  of  probability  distributions,  tolerance 
limits,  or  principle-derived  sets  of  correct  solutions  to  tactical 
problems . 

To  establish  standards  in  one  or  more  of  these  formats,  large 
amounts  of  ES  outcome  data  must  be  obtained  so  that  the  characteristics 
of  the  distribution  of  ES  outcomes  cam  be  determined.  Because  repli¬ 
cation  of  field  exercises  is  difficult  and  costly,  the  distribution  of 
ES  outcomes  cannot  be  generated  in  field  exercises.  As  part  of  the  ES 
research  program,  therefore,  inexpensive  simulations  of  ES  exercises 
are  being  developed  to  provide  large  amounts  of  valid  ES  outcome  data. 

In  one  of  the  current  modeling  efforts,  the  Combat  Operations 
Training  Effectiveness  Analysis  Model  (COTEAM) ,  the  concept  of  situation- 
specific  forecasting  is  being  used  to  develop  an  ES  outcome  data  base 
from  which  the  characteristics  of  the  distribution  of  ES  outcomes  can 
be  determined.  Situation-specific  means  that  the  forecasting  procedures 
replicate  the  particular  field  exercise  conditions  as  closely  as  possi¬ 
ble;  a  forecasting  exercise  uses  the  same  force  ratios,  weapons  mix, 
terrain,  weather  conditions,  and  missions  as  the  corresponding  field 
exercise. 

The  purpose  of  the  forecasting  efforts  is  to  generate  a  data  base 
of  ES  outcomes  from  which  expectations  about  tactical  processes  and 
casualties  can  be  derived  for  units  participating  in  ES  field  exercises. 
The  methods  being  developed  or  adapted  for  generating  the  data  base  in¬ 
clude  (a)  military  experts'  DELPHI,  (b)  board  war  games,  and  (c)  com¬ 
puterized  ES  models.  According  to  the  COTEAM  model,  if  the  forecasts 
obtained  using  these  methods  agree  with  those  observed  in  ES  field  ex¬ 
ercises,  then  these  methods  can  be  used  to  develop  performance  criteria 
against  which  unit  performance  in  ES  exercises  can  be  compared. 

In  assessing  the  similarities  between  forecasting  data  and  observed 
field  data,  differences  can  be  determined  either  statistically  or  using 


the  Turing  Test.  The  Turing  Test  states  that  if  outputs  from  two  dif¬ 
ferent  data  sources  are  given  to  an  information  processor,  and  the  pro¬ 
cessor  cannot  distinguish  between  the  two  data  sources,  then  the  data 
sources  are  considered  to  be  identical. 

Recent  work  by  ARI  suggests  that  behavioral  forecasting  is  a  vi¬ 
able  means  of  developing  an  ES  data  base.  During  the  REALTRAIN  valida¬ 
tion  of  rifle  squads  at  Fort  Ord,  Calif.,  in  May  1977, ^  military  experts 
made  forecasts  about  the  outcomes  of  specific  ES  exercises.  The  data^ 
indicate  that  experts  can  make  this  type  of  forecast  and  that  their 
forecasts  are  sensitive  to  such  factors  as  the  training  and  combat¬ 
readiness  level  of  the  unit  being  evaluated. 

At  the  armor  Combined  Arms  Test  (CATEST)  at  Fort  Carson,  Colo., 
from  January  to  April  1978,  board  war  games4  were  used  to  collect  fore¬ 
casting  data  about  the  ES  field  exercises.  Using  the  Fort  Carson  Fore¬ 
casting  Game,  a  board  war  game  specifically  designed  for  the  terrain 
and  scenarios  used  in  the  CATEST,  board  exercises  identical  to  ES  field 
exercises  were  conducted.  The  results  were  assessed  in  terms  of  the 
tactical  maneuver  routes,  casualties  suffered,  and  casualties  inflicted 
by  each  type  of  weapon  system.  The  maneuver  routes  from  the  two  types 
of  exercises  were  comparable;  however,  the  field  maneuver  routes  tended 
to  be  slightly  more  complex  than  the  board  game  routes.  The  casualties 
suffered  were  almost  identical  for  both  types  of  exercises,  and  the 
casualties  inflicted  by  each  type  of  weapon  system  were  also  similar. 

The  only  sizable  differences  were  the  percentages  of  casualties  inflicted 
by  tanks  and  casualties  inflicted  by  artillery.  These  differences  were 
attributed  to  slight  variations  in  the  way  ES  rules  were  enforced  in  the 
field  exercises  and  in  the  board  games. 

The  two  studies  (Mirabella,  1977;  Medlin,  1979)  established  the 
feasibility  of  forecasting  as  a  means  of  generating  an  ES  data  base. 

The  data  can  be  generated,  and  they  closely  resemble  the  data  observed 
in  field  exercises.  But  how  closely  do  they  resemble  field  data?  Do 
forecast  data  agree  with  field  data  enough  to  be  used  to  develop 
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behavioral  benchmarks  or  standards?  Ultimately,  the  final  decision  is 
a  subjective  one,  but  further  research  can  help  to  establish  the  valid¬ 
ity,  or  the  similarity,  between  field  and  forecast  data.  As  Medlin 
(1979)  noted,  because  of  the  severe  restrictions  on  sample  size,  no  in¬ 
ferential  statistics  could  be  used  to  assess  differences  between  the 
two  types  of  data.  Furthermore,  since  much  of  the  data  collected  is 
"process"  data  (for  example,  on  maneuver  routes,  firing  positions,  and 
overwatch  positions) ,  the  results  of  statistical  analyses  may  be  mis¬ 
leading  even  if  such  analyses  can  be  performed.  Any  of  several  maneuver 
routes,  firing  positions,  or  overwatch  positions  may  be  reasonable  for  a 
given  exercise.  Statistical  analyses  may  show  significant  differences 
that  are  not  in  fact  meaningful.  Thus,  it  is  not  important  to  demonstrate 
statistical  differences;  rather,  it  is  important  that  the  forecasting 
procedure  should  generate  expectations  that  are  not  significantly  dif¬ 
ferent  to  an  information  processor  or  a  military  expert  from  the  outcomes 
observed  in  field  exercises. 

The  present  research  attempted  to  partially  validate,  or  establish, 
the  similarities  between  forecast  data  and  ES  field  exercise  data  by 
subjecting  the  data  to  the  Turing  Test.  The  study  was  to  determine 
whether  military  officers  can  distinguish  between  forecast  and  field 
data  (for  example,  the  maneuver  routes,  casualties  suffered,  and  casu¬ 
alties  inflicted  by  weapon  type)  from  the  CATEST  field  exercises  and 
from  the  corresponding  board  war  games.  As  the  Turing  Test  is  applied 
in  this  context,  if  military  officers  cannot  distinguish  between  gener¬ 
ated  and  observed  ES  outcome  data  and  cannot  distinguish  between  the 
two  sets  of  process  data  (one  forecast  and  one  collected  in  field  exer¬ 
cises)  ,  then  the  two  data  sources  are  considered  to  be  identical.  This 
result  would  provide  further  support  for  the  use  of  forecast  data  as  a 
means  of  developing  performance  benchmarks  or  standards  against  which 
unit  performance  can  be  compared. 


METHOD 

Participants 

Sixty-six  military  officers  from  the  maneuver  arms  units  at  Fort 
Carson,  Colo.,  served  as  participants  for  the  study  (see  Appendix  A). 
The  officers  participated  in  the  experiment  as  part  of  their  required 
weekly  leadership  training  class. 


Design 

Booklets  were  constructed  containing  a  background  information 
sheet  (Appendix  A) ,  a  response  sheet  (Appendix  B) ,  three  maps  of  man¬ 
euver  routes  from  CATEST  field  exercises  (Appendix  C) ,  three  maps  of 
maneuver  routes  from  the  corresponding  Fort  Carson  Forecasting  Game 
exercises  (Appendix  D) ,  a  table  summarizing  CATEST  field  exercise  casu¬ 
alty  data,  i.e.,  casualties  suffered  by  weapon  systems  inflicting 


casualties  (Appendix  E) ,  and  a  table  summarizing  forecast  casualty  data 
(Appendix  F) . 

Excluding  the  background  information  and  response  sheets,  the  ma¬ 
terial  in  each  booklet  was  randomly  ordered  to  eliminate  possible  order 
or  sequential  effects.  The  background  information  sheet  obtained  in¬ 
formation  that  might  be  related  to  am  officer’s  ability  to  distinguish 
field  exercise  data  from  board  war  game  data  (for  example,  rank,  combat 
experience,  REALTRAIN  experience,  board  war  game  experience,  years  in 
service ,  and  education) . 

The  response  sheet  provided  space  for  the  officer  to  indicate 
which  map  or  table  he  was  considering  and  whether  he  thought  the  data 
were  real  (field  exercise  data)  or  simulated  (board  war  game  data).  The 
response  sheet  also  provided  a  line  marked  from  zero  to  100  in  incre¬ 
ments  of  10  on  which  the  officer  was  to  indicate  "how  much  confidence" 
he  had  in  his  decision  about  whether  the  data  were  real  or  simulated. 
Finally,  the  response  sheet  provided  a  space  in  which  the  officer  could 
indicate  whether  or  not  he  was  guessing,  or,  if  not  guessing,  to  indi¬ 
cate  which  factors  influenced  his  decision.  The  six  maps  of  maneuver 
routes  were  copies  of  observed  field  exercise  data  or  the  generated  game 
data  for  the  same  exercise.  The  two  tables  of  casualties  were  the  sum¬ 
mary  table  for  the  CATEST  field  exercises  and  the  summary  table  for  the 
Fort  Carson  Forecasting  Game  exercises. 


Procedure 


Each  officer  received  a  booklet  containing  all  the  necessary  ma¬ 
terials.  The  experimenter  described  the  task  to  the  officers  and  ex¬ 
plained  the  background  information  sheet,  response  sheet,  map  data,  and 
casualty  data  in  considerable  detail.  Questions  were  answered  as  com¬ 
pletely  as  possible  without  compromising  the  integrity  of  the  experiment 
Each  officer  then  filled  out  the  background  information  sheet,  studied 
the  map  and  casualty  data,  and  filled  out  the  response  sheet.  When  all 
officers  had  finished  and  all  booklets  were  collected,  the  experimenter 
debriefed  the  participants. 


RESULTS 


Maneuver  Routes 


Each  participant  was  asked  to  indicate  whether  each  of  six  maps 
of  maneuver  routes  depicted  real  (field  exercise)  data  or  simulated 
(game  board)  data.  Half  of  the  maps  were  from  field  exercises  and  half 
were  from  game  board  exercises.  If  participants  were  not  able  to  dis¬ 
tinguish  between  the  two  types  of  data,  they  should  guess  correctly  on 
three  of  the  six  maps.  The  mean  number  of  correct  responses  was  2.99. 
(Alt  of  396  responses  (six  for  each  of  the  66  officers) ,  197  were  correct 
only  1  less  than  the  198  expected  by  chance .  Table  1  shows  distribution 


of  the  number  of  correct  responses.  Most  of  the  participants  (50  out 
of  66)  responded  correctly  on  two,  three,  or  four  of  the  six  maneuver 
route  maps. 


Table  1 

Distribution  of  Number  of  Correct  Responses 


Number  of 
correct  responses 

Frequency 

0 

1 

1 

7 

2 

18 

3 

19 

4 

13 

5 

3 

6 

5 

Because  of  the  difficulties  inherent  in  trying  to  "accept"  the 
null  hypothesis  (see  Greenwald^  or  Bakan6  for  a  discussion  of  the  issues 
involved) ,  confidence  intervals  for  the  "true"  mean  number  of  correct 
responses  were  constructed.  The  99.5%  confidence  limits  are  2.54  and 
3.44,  the  99%  confidence  limits  are  2.59  and  3.39,  and  the  95%  confidence 
limits  are  2.71  and  3.27.  Thus,  one  can  be  95%  certain  that  the  "true" 
population  mean  lies  between  2.71  and  3.27. 

Even  though  the  overall  mean  of  correct  responses  is  2.99,  it  is 
possible  that  some  systematic  relationship  exists  between  the  real  and 
simulated  data  and  the  responses  of  "real”  and  "simulated"  given  by  the 
subjects.  In  the  worst  possible  case,  participants  could  correctly 
identify  all  the  real  exercises  and  misidentify  all  the  simulated  ex¬ 
ercises,  yet  the  observed  mean  would  still  be  3.00.  As  Table  2  shows, 
there  is  no  systematic  relationship  between  the  source  of  the  data  and 
the  participants'  responses  about  the  source  of  the  data  (X2  *  1.70, 
df  «  1,  n.s.) . 


^Greenwald,  A.  G.  Consequences  of  Prejudice  Against  the  Null  Hypothesis. 
Psychological  Bulletin,  1975,  £(61) ,  1-20. 

^Bakan,  D.  The  Test  of  Significance  in  Psychological  Research.  Psycho¬ 
logical  Bulletin,  1966,  66(6),  423-437. 
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Table  2 


Frequency  That  Real  and  Simulated  Data  Were 
Classified  Real  and  Simulated 


Real 

Simulated 

Classified  as 

real 

105 

106 

Classified  as 

simulated 

93 

92 

The  above  results  indicate  that,  overall,  the  participants  cannot 
distinguish  between  real  and  simulated  maneuver  routes.  Certain  indi¬ 
viduals,  however,  may  be  able  to  discern  one  type  of  data  from  the 
other  because  of  combat  experience,  years  in  service,  or  some  other 
experiential  background.  Statistical  analyses  reveal  that  the  number 
of  correct  responses  does  not  differ  as  a  function  of  rank,  combat  ex¬ 
perience,  REALTRAIN  experience,  board  war  game  experience,  familiarity 
with  the  exercise  test  lanes,  years  in  service,  or  education. 

Each  participant  also  indicated  how  certain  he  was  of  his  response 
and  if  he  was  guessing.  The  number  of  admitted  guesses  does  not  differ 
as  a  function  of  any  of  the  background  information,  and  the  mean  confi¬ 
dence  response  of  the  participants  differs  marginally  (t  *  -2.18, 
df  =  64,  p  <  .033)  as  a  function  of  REALTRAIN  experience  only.  Officers 
with  REALTRAIN  experience  were  more  confident  of  their  responses  than 
were  participants  with  no  REALTRAIN  experience.  Furthermore,  neither 
confidence  nor  admitted  guessing  varied  as  a  function  of  the  correctness 
of  the  response. 


Casualty  Data 

Participants  were  also  given  two  tables,  one  from  field  exercise 
data  and  one  from  forecast  data,  that  provided  summary  information  on 
the  casualties  suffered  and  the  casualties  inflicted  by  each  weapon  sys¬ 
tem.  The  participants  were  asked  to  indicate  which  table  contained  data 
from  field  exercises.  If  they  were  unable  to'  distinguish  between  the 
two  types  of  data,  the  participants  should  have  guessed  correctly  half 
of  the  time.  Only  53  of  the  66  participants  responded  to  this  question; 
of  the  53,  only  20  correctly  determined  the  field  exercise  casualty 
data  (X2  *  3.57,  df  *  1,  p  <  .062).  Thus,  there  is  tendency  for  the 
participants  to  classify  the  real  data  as  simulated.  None  of  the  back¬ 
ground  data  was  related  to  the  participants’  ability  to  correctly  clas¬ 
sify  the  casualty  information. 


DISCUSSION 


As  part  of  ARI's  research  on  improved  training  and  evaluation  sys¬ 
tems,  am  evaluation  system  for  two-sided  tactical  field/maneuver  exer¬ 
cises  is  being  developed.  To  evaluate  unit  performance  and  assess  the 
units'  combat  readiness  and/or  training  deficiencies  amd  proficiencies, 
performance  stamdards  or  benchmarks  must  be  defined.  The  COTEAM  model 
uses  the  concept  of  situation-specific  forecasting  to  provide  benchmarks. 
Because  of  the  nature  of  the  two-sided  tactical  play,  however,  the  stan¬ 
dards  cannot  be  exact  or  deterministic;  they  must  be  in  the  form  of 
probability  distributions,  toleramce  limits,  or  principle-derived  sets 
of  correct  solutions  to  tactical  problems.  After  these  expectations 
about  casualties  and  tactical  processes  have  been  established,  ES  out¬ 
comes  can  be  compared  to  them  to  assess  deficiencies  and  readiness  levels 

This  study  was  designed  to  partially  validate  a  board  war  game  fore¬ 
casting  procedure  by  determining  whether  military  officers  can  discrimi¬ 
nate  between  field  exercise  data  and  data  generated  in  a  board  game.  Us¬ 
ing  the  field  exercise  and  generated  forecast  data  from  the  CATEST  at 
Fort  Carson,  Colo.,  military  officers  attempted  to  distinguish  the  field 
maneuver  routes  from  the  simulated  maneuver  routes. 

The  results  suggested  that  officers  could  not  distinguish  the  simu¬ 
lated  data  from  the  real  data,  and  that  a  participant's  experiential  back¬ 
ground  was  not  related  to  the  number  of  correct  responses  obtained.  Fur¬ 
thermore,  neither  estimated  confidence  in  the  response  nor  admitted 
guessing  were  related  to  the  correctness  of  the  response.  REALTRAIN  ex¬ 
perience  increased  a  participant's  confidence  in  his  response,  but  no 
other  background  data  were  related  to  confidence  or  admitted  guessing. 

When  considering  the  casualty  data,  the  officers  correctly  identified 
the  field  exercise  data  in  only  20  of  53  cases. 

In  informal  postexperimental  question-and-answer  periods,  the  of¬ 
ficers  said  the  ES  field  exercise  data  seemed  unrealistic.  They  doubted 
that  infantry  and  grenades  could  destroy  tanks,  TOWs,  and  APCs  as  was 
evidenced  in  the  field  exercises  (Appendix  E) .  They  also  felt  that  tanks 
had  too  little  impact  on  the  field  exercise  casualties. 

The  game  board  data  may  have  seemed  more  realistic  because  the  of¬ 
ficers  were  not  aware  of  "realistic"  casualty  data  or  because  the  REAL- 
TRAIN  casualty  assessment  rules  were  not  appropriate. 

In  either  c ase,  more  realistic  casualty  assessment  techniques  for 
ES  exercises  will  be  provided  in  the  Multiple  Integrated  Laser  Engagement 
Simulation  (MILES)  system,  and  the  forecast  game  will  generate  data  more 
closely  resembling  the  field  exercise  data  by  strictly  adhering  to  the 
MILES  casualty  rules.  These  developments  should  eliminate  the  major  dis¬ 
crepancies  between  the  field  and  forecast  casualty  data. 


The  results  of  this  study  suggest  that  military  officers  cannot 
distinguish  field  exercise  data  from  forecast  data  generated  in  game 
board  exercises.  According  to  the  Turing  Test,  therefore,  these  two 
data  sources  may  be  considered  to  be  identical.  Game  board  exercises 
generate  data  that  are  similar  enough  to  field  exercise  data  to  be  used 
to  determine  the  characteristics  of  the  distribution  of  ES  outcomes 
which,  in  turn,  can  be  used  to  define  performance  benchmarks  or  standards 
for  units  participating  in  ES  field  exercises. 

Although  the  initial  steps  in  validating  the  board  war  game  fore¬ 
casting  procedures  have  been  taken,  more  research  is  necessary  before 
forecasting  can  be  espoused  as  a  valid,  reliable  means  of  generating 
data  for  the  purpose  of  establishing  behavioral  benchmarks  or  standards. 
The  effects  of  different  levels  of  training  (for  the  forecasters)  on 
forecasting  must  be  assessed  and  conqpared  to  the  effects  of  different 
training  levels  (for  the  unit)  on  ES  field  exercises.  If  forecasting 
is  to  be  used  to  provide  behavioral  standards,  the  forecast  data  should 
reflect  the  same  types  of  differences  due  to  training  level  as  are  evi¬ 
dent  in  field  exercises.  As  a  long-term  goal,  it  would  be  fruitful  to 
develop  learning  curves  for  ES  field  exercises  and  forecasting  exercises 
and  then  compare  the  two. 

A  short-term  research  effort  can  be  directed  to  developing  a  rela¬ 
tively  large  data  base  for  a  few  selected  exercises  and  then  comparing 
the  results  observed  in  the  field  with  the  generated  expectations.  Pro¬ 
vided  sufficient  manpower  resources  are  available,  considerably  more 
data  them  maneuver  routes  and  casualties  can  be  collected  and  compared 
with  the  ES  field  exercise  data.  These  data  may  include  detection  dis¬ 
tances  and  locations,  firing  patterns  of  vehicles,  indirect  fire  place¬ 
ment,  or  communications. 

It  is  then  of  considerable  interest  to  determine  how  much  and  what 
types  of  information  are  necessary  for  military  officers  to  distinguish 
between  field  and  forecast  data.  Determining  this  additional  informa¬ 
tion  will  result  in  a  better  understanding  of  the  dynamics  of  tactical 
behavior  and  an  improved  set  of  forecast  procedures.  Successive  itera¬ 
tions  and  modifications  of  the  forecasting  procedures  will  help  to  de¬ 
velop  a  realistic  data  base  from  which  performance  standards  can  be 
derived . 


APPENDIX  A 


SUMMARY  OF  BACKGROUND  INFORMATION  ON  PARTICIPANTS 


Rank:  2LT  1LT  CPT  MAJ  LTC  COL 

22  22  13  3  3  3 

Combat  experience:  YES  NO 

12  54 

REALTRAIN  experience:  YES  NO 

40  26 

Board  war  game  experience:  YES  NO 

51  15 

Familiarity  with  test  lanes:  YES  NO 

29  37 

Years  in  service:  LESS  THAN  1  1-2  3-4  5-6  7-12  MORE  THAN  12 

2  28  16  7  7  6 

Education:  H.S.  COLLEGE  POST-GRADUATE 

5  7  4 


APPENDIX  D 


MANEUVER  ROUTES  FROM  TORT  CARSON  FORECASTING  GAME  EXERCISES 


Target  Frequencies  Target  Percentages 


21 


Total  Total 

18  80  15  6  104  223  _ 


BOARD  GAME  CASUALTY  S> 


Frequencies 

TOW  TK  APC  1/4T.TR.  INF.  TOTAL 

36 

32 

81 
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14 

ON 

iH 

■ 

76 
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■ 
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45 

CM 
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76 

■ 

■ 

128 
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1 

1 

1 

1 

1 

1 

1 

1 

1 

VO 

VO 

o> 
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vO 

in 
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■ 

■ 

■ 

CO 

CO 

18 

20 

22 

■ 

1 

■ 

■ 

■ 

■ 

82 

VO 

in 

■ 

1 

■ 

■ 

■ 

■ 

18 

V.  Target 

Firer 

Artillery 

TOW 

Tanks 

APC 

M60 

Infantry 

Other 

Total 

1231 
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t  Ofc  of  Naval  Rsch,  Arlington,  ATTN:  Code  441 

1  Naval  Aerospc  Med  Res  Lah.  Pensacola.  ATTN:  Acous  Sch  Div 

I  Naval  Aerosiic  Med  Res  Lab,  Pensacola.  ATTN:  Code  L51 

1  Naval  Aarospc  Med  Res  Lab,  Pensacola.  ATTN:  Code  L6 

1  Chief  of  NavPers.  ATTN:  Pers-OR 

1  NAVAIRSTA.  Norfolk,  ATTN:  Safety  Ctr 

1  Nav  Oceanographic,  DC.  ATTN:  Code  6251.  Charts  ft  Tech 

1  Center  of  Naval  Anal.  ATTN:  Doe  Ctr 

1  NavAirSysCom.  ATTN:  AIR-  531% 

1  NavBuMed.  ATTN:  713 
1  NavHellcopterSubSqua  2.  FPO  SF  86601 
1  AFHRL  (FT)  Williams  AFB 
I  AFHRL  <TT)  Lowry  AFB 

1  AFHRL  (AS)  WPAFB,  OH 

2  AFHRL  (DOJZ)  Brooks  AFB 

1  AFHRL  (DOJNI  Lackland  AFB 
1  HOUSAF  (INYSD) 

1  HOUSAF  (DPXXA) 

1  AFVTG  (RDI  Randolph  AFB 

3  AMRL  (HEI  WPAFB.  OH 

2  AF  Inst  of  Tech,  WPAFB.  OH.  ATTN:  ENE/SL 
1  ATC  (XPTDI  Randolph  AFB 

I  USAF  AeroMed  Lib,  Brooks  AFB  (SUL-4),  ATTN:  DOC  SEC 
1  AFOSR  (NL).  Arlington 

I  AF  LogCmri,  McClellan  AFB.  ATTN.  ALC/DPCRB 

1  Air  Force  Academy,  CO,  ATTN:  Dept  of  Bel  Sen 
5  NavPers  ft  Dev  Ctr.  San  Diego 

2  Navy  Med  Neuropsychiatric  Rsch  Unit,  San  Diego 
1  Nav  Electronic  Lab.  San  Diego.  ATTN:  Ret  Lab 

1  Nav  TrngCen.  San  Diego,  ATTN:  Code  8000-Lib 
1  NavPostGraSch,  Monterey,  ATTN:  Code  66Aa 
1  NavPostGraSch.  Monterey.  ATTN:  Code  2124 
1  NavTrngEquipCtr,  Orlando.  ATTN:  Tech  Lib 
1  US  Dept  of  Labor.  DC,  ATTN:  Manpower  Admin 
1  US  Dept  of  Justice.  DC,  ATTN:  Drug  Enforce  Admin 
1  Nat  Bur  of  Standards,  DC,  ATTN:  Computer  Info  Section 
t  Nat  Clearing  House  for  MH-  Info,  Rockville 
1  Oenver  Federal  Ctr,  Lakewood,  ATTN:  BLM 
12  Defense  Documentation  Center 

4  Oir  Psych.  Army  Hq,  Russell  Ofcs,  Canberra 

1  Scientific  Advsr,  Mil  Bd,  Army  Hq,  Russell  Ofcs,  Canberra 
1  Mil  and  Air  Attache,  Austrian  Embassy 

1  Centre  da  Recherche  Det  Facteurs,  Humaine  de  la  Defense 
Rationale,  Brussels 

2  Canadian  Joint  Staff  Washington 

1  C/Air  Staff.  Royal  Canadian  AF,  ATTN:  Pert  Std  Anal  Br 

3  Chief.  Canadian  Oaf  Rsch  Staff.  ATTN:  C/CRDSIW) 

4  British  Def  Staff,  British  Embassy.  Washington 


1  US  Marine  Corps  Liaison  Ofc.  AMC.  Alexandria.  ATTN:  AMCGS-F 
1  USATRADOC.  Ft  Monroe,  ATTN:  ATRO-EO 
6  USATRADOC.  Ft  Monroe,  ATTN:  ATPR-  AD 
1  USATRADOC.  Ft  Monroe.  ATTN:  ATTS-EA 

1  USA  Forces  Cmd,  Ft  McPherson.  ATTN:  Library 

2  USA  Aviation  Test  Bd,  Ft  Rucker,  ATTN:  STEBG-PO 

1  USA  Agcy  for  Aviation  Safety,  Ft  Rucker,  ATTN:  Library 
4  USA  Agcy  for  Aviation  Safety,  Ft  Rucker.  ATTN:  Edue  Advisor 
1  USA  Aviation  Sch,  Ft  Rucker,  ATTN:  PO  Drawer  0 

1  HQUSA  Aviation  Sys  Cmd.  St  Louis.  ATTN:  AMSAV-ZDR 

2  USA  Aviation  Sys  Test  Act.,  Edwatds  AFB,  ATTN:  SAVTE-T 


